Harnessing the Bethe free energy†
نویسندگان
چکیده
A wide class of problems in combinatorics, computer science and physics can be described along the following lines. There are a large number of variables ranging over a finite domain that interact through constraints that each bind a few variables and either encourage or discourage certain value combinations. Examples include the k-SAT problem or the Ising model. Such models naturally induce a Gibbs measure on the set of assignments, which is characterised by its partition function. The present paper deals with the partition function of problems where the interactions between variables and constraints are induced by a sparse random (hyper)graph. According to physics predictions, a generic recipe called the "replica symmetric cavity method" yields the correct value of the partition function if the underlying model enjoys certain properties [Krzkala et al., PNAS (2007) 10318-10323]. Guided by this conjecture, we prove general sufficient conditions for the success of the cavity method. The proofs are based on a "regularity lemma" for probability measures on sets of the form Ωn for a finite Ω and a large n that may be of independent interest. © 2016 Wiley Periodicals, Inc. Random Struct. Alg., 49, 694-741, 2016.
منابع مشابه
Assessment of the Potential of Harnessing Tidal Energy in the Khowr-e Musa Estuary in the Persian Gulf
Today, the widespread use of fossil fuels is caused many problems in the world, which include: Ozone depletion, the increase carbon dioxide in the atmosphere, growing recognition of climate change impacts and decreasing fossil fuel resources. These issues have led to an increased interest in the mass generation of electricity from renewable sources such tidal energy. The Khowr-e Musa Estuary, l...
متن کاملBethe Free Energy and Locally Consistent Marginals Lecturer : Andrea Montanari Scribe : Krishnamurthy Iyer 1 Bethe Free Energy
. Note that there are three terms in the expression, one for each edge, one for each factor node, and one for each variable node in the factor graph. The following claim justifies the study of Bethe free energy. Claim 1. For any factor graph, the stationary points of the Bethe free energy correspond to the fixed points of the Belief Propagation algorithm and vice versa. That is, ∂GB ∂ν = 0 if a...
متن کاملThe Bethe Permanent of a Non - Negative Matrix ∗ Pascal
It has recently been observed that the permanent of a non-negative matrix, i.e., of a matrix containing only nonnegative real entries, can very well be approximated by solving a certain Bethe free energy minimization problem with the help of the sum-product algorithm. We call the resulting approximation of the permanent the Bethe permanent. In this paper we give reasons why this approach to app...
متن کاملAn approximate analytical solution of the Bethe equation for charged particles in the range of radiotherapy energy
Charged particles such as protons and carbon ions are an increasing tool in radiation therapy. However, unresolved physical problems prevent optimal performance, including estimating the deposited dose in non-homogeneous tissue, is an essential aspect of optimizing treatment. The Monte Carlo (MC) method can be used to estimate the amount of radiation, but, this powerful computing operation is v...
متن کاملGraph Zeta Function in the Bethe Free Energy and Loopy Belief Propagation
We propose a new approach to the analysis of Loopy Belief Propagation (LBP) byestablishing a formula that connects the Hessian of the Bethe free energy with theedge zeta function. The formula has a number of theoretical implications on LBP.It is applied to give a sufficient condition that the Hessian of the Bethe free energyis positive definite, which shows non-convexity for...
متن کاملMIME: Mutual Information Minimization and Entropy Maximization for Bayesian Belief Propagation
Bayesian belief propagation in graphical models has been recently shown to have very close ties to inference methods based in statistical physics. After Yedidia et al. demonstrated that belief propagation fixed points correspond to extrema of the so-called Bethe free energy, Yuille derived a double loop algorithm that is guaranteed to converge to a local minimum of the Bethe free energy. Yuille...
متن کامل